Claims 



1 . (Currently Amended) A method for use in detecting faces within a digital 
image, the method comprising: 

processing via a processor, in a pre-filter stage, a set of digital image data to 
produce a set of initial candidate portions using at least one feature algorithm, the pre- 
filter stage including a linear filter based on a decision function having coefficients that 
are determined during a learning procedure; 

processing via a processor, in a boosting filter stage, rfallthe set of initial candidate 
portions of digita l im a g e data to produce a set of intermediate candidate portions, the 
boosting filter stage including: 

a boosting chain having a plurality of boosting chain nodes to identify 
candidate portions and a boot strap function following each of the plurality of 
boosting chain nodes, the boot strap function to use a weak learner of a previous 
boosting chain node in training another boosting chain node of the boosting 
chain; and 

processing via the processor, the set of intermediate candidate portions in a post- 
filter stage to produce a set of final candidate portions, wherein the post-filter stage 
includes an image pre-processing process, a color-filter process, and a support vector 
machine (SVM) filter process. 

2. (Withdrawn) The method as recited in Claim 1, further comprising dividing a 
digital image into a plurality of portions. 
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3. (Withdrawn) The method as recited in Claim 2, wherein at least one of said 
plurality of portions has a shape selected from a group of shapes comprising a 
rectangle and a square. 



4. (Withdrawn) The method as recited in Claim 2, further comprising processing 
said plurality of portions using a pre-filter stage that is configured to output said set of 
initial candidate portions selected from said plurality of portions based on at least one 
feature. 

5. (Withdrawn) The method as recited in Claim 4, wherein said feature includes 
at least one feature selected from a group of features comprising a Haar-like feature, an 
extended feature, a mirror invariant feature, and a variance feature. 

6. (Withdrawn) The method as recited in Claim 4, wherein said pre-filter stage 
includes a linear filter. 

7. (Withdrawn) The method as recited in Claim 6, wherein said linear filter is 
based on a weak learner. 

8. (Withdrawn) The method as recited in Claim 6, wherein said linear filter is 
based on a decision function of H<.x)~{a i Mx)>b l )A(a 2 (f l (x)+rf 2 (x))>b 2 ) _ wherejn «, b, 
where i = 1, 2 and '' e H>i) are coefficients determined during a learning procedure and 
fi and f 2 are features selected from a group of features, 
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9. (Withdrawn) The method as recited in Claim 1 , further comprising training said 
boosting chain using face images, non-face images, and weak classifiers. 

10. (Withdrawn) The method as recited in Claim 9, wherein said boosting chain 
includes a plurality of boosting nodes arranged in an order within said boosting chain. 

11. (Withdrawn) The method as recited in Claim 10, wherein said boosting chain is 
trained using boosting classifiers corresponding to said boosting nodes. 

12. (Withdrawn) The method as recited in Claim 10, wherein a sample weight 
initialized for a current boosting classifier is adjusted based on a classification error rate 
of a previous boosting node within said order. 

13. (Withdrawn) The method as recited in Claim 1, wherein said boosting chain 
includes a hierarchical chain structure. 

14. (Withdrawn) The method as recited in Claim 1 , wherein said boosting filter 
stage includes an LSVM optimization. 

15. (Withdrawn) The method as recited in Claim 14, wherein said LSVM 
optimization is capable of finding a global maximum. 



Serial No.: 10/621,260 A 

Atty Docket no.: msi-1528us ~* lee(gjhayes The Business of IP® 

www.leehayes.com • 509.324.9256 



16. (Withdrawn) The method as recited in Claim 15, wherein finding said global 
maximum is based on: 



c > is set according to a classification risk'" and trade-off constant c over a training set 



17. (Withdrawn) The method as recited in Claim 1 , wherein said post-filter stage 
includes image pre-processing and masking processing. 

18. (Withdrawn) The method as recited in Claim 17, wherein said image pre- 
processing includes lighting correction processing. 

19. (Withdrawn) The method as recited in Claim 17, wherein said image pre- 
processing includes histogram equalization processing. 

20. (Withdrawn) The method as recited in Claim 1 , wherein said post-filter stage 
includes at least a color filter process. 

21 . (Withdrawn) The method as recited in Claim 1 , wherein said post-filter stage 
includes at least an SVM filter process. 




and wherein coefficient 




\wC if Xj is a face pattern 
C otherwise 
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22. (Withdrawn) The method as recited in Claim 1 , further comprising outputting 
information associated with at feast said final candidate portion. 

23. (Withdrawn) The method as recited in Claim 22, wherein said information 
identifies at least said final candidate portion. 

24. (Withdrawn) The method as recited in Claim 22, wherein said information 
includes at least said final candidate portion. 

25. (Withdrawn) The method as recited in Claim 22, wherein said information 
identifies rotation data associated with at least said final candidate portion. 

26. (Currently Amended) The method as recited in Claim 1 , wherein the at least 
one feature based algorithm uses Haar like features f urth e r compr i sing e mp l oying at 
l east on e f e atur e bas e d algor i thm . 

27. (Currently Amended) The method as recited in Claim 1[[26]], wherein the 
decision function is (a, f } (x) > b, ) a (a 2 (/,(*) + rf 2 (*)) > b 2 ) , where (a, f x (x) > 6, ) is a simple 
decision stump function learned by adjusting a threshold according to face/non-face 
histograms of the at least one feature and (a 2 (/; (x) + rf 2 (x)) > b 2 ) is acquired by a Linear 
Support Vector Machine (LSVM) optimization processes said at l e ast on o f e atur e bac o d 
a l gor i thm u s e s H a ar -l ik e f e atur e s . 
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28. (Currently Amended) The method as recited in Claim 26, wherein said-the at 
least one feature-based algorithm uses extended features. 

29. (Currently Amended) The method as recited in Claim 26, wherein said-the at 
least one feature-based algorithm uses mirror invariant features. 

30. (Previously Presented) The method as recited in Claim 29, wherein an extra 
constraint of the mirror invariant is added to reduce the size of a feature set associated 
with said mirror invariant features. 

31 . (Currently Amended) The method as recited in Claim 26, wherein saklthe at 
least one feature-based algorithm uses variance features. 

32. (Withdrawn) The method as recited in Claim 1 , further comprising performing 
in-plane estimation to detect an orientation of said face image data. 

33. (Withdrawn) The method as recited in Claim 32, wherein said orientation is with 
respect to an up-right position. 

34. (Withdrawn) The method as recited in Claim 33, further comprising performing 
up-right face detection based on said in-plane estimation. 

35. (Withdrawn) The method as recited in Claim 34, wherein said up-right face 
detection is configured to identify out-plane rotation variations of said face image data. 
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36. (Withdrawn) The method as recited in Claim 35, wherein said out-plane 
rotation variations are within a range of e =H 5 °. 45 °]. 

37. (Withdrawn) The method as recited in Claim 21, wherein said SVM filter 
process is performed in a redundancy reduced feature space. 

38. (Withdrawn) The method as recited in Claim 37, wherein said SVM filter 
process further includes performing wavelet transformation to divided the original 
images into four sub-bands LL, HL, LH and HH. 

39. (Withdrawn) The method as recited in Claim 38, wherein said SVM filter 
process is configured to reduce said redundancy based on 

k\u,v)= £(j,Vv/ +i\) 2 

0<i<4 

wherein each vector "<and v > corresponds to an / h sub-band portion. 

40. (Withdrawn) The method as recited in Claim 38, further comprising selectively 
cropping of four sub-band portions. 

41 . (Currently Amended) A computer-readable medium having computer- 
implementable instructions for causing at least one processing unit to perform acts 
comprising: 

detecting possible human face image data within a digital image using a multiple 
stage face detection scheme that includes: 
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a boosting filter stage to process a set of initial candidate portions of digital image 
data to produce a set of intermediate candidate portions using a plurality of boosting 
chain nodes and a boot strap function following each of the plurality of boosting chain 
nodes, the boot strap function to adjust a sample weight initialized for a current boosting 
classifier of a current boosting chain node based on a classification error rate of a 
previous boosting node; and 

a post-filtering stage configured to process said-the set of intermediate 
candidate portions to produce a set of final candidate portions, wherein the post-filter 
stage includes an image pre-processing process, a color-filtering process, and a 
support vector machine (SVM) filtering process , the SMV filtering process to perform 
wavelet transformation on the set of intermediate candidate portions . 

42. (Withdrawn) The computer-readable medium as recited in Claim 41 , further 
comprising dividing a digital image into a plurality of portions, and wherein at least one 
of said plurality of portions has a shape selected from a group of shapes comprising a 
rectangle and a square. 

43. (Original) The computer-readable medium as recited in Claim 41 , wherein said 
multiple stage face detection scheme further includes a pre-filter stage that is configured 
to output said set of initial candidate portions selected from said plurality of portions 
based on at least one feature. 
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44. (Original) The computer-readable medium as recited in Claim 43, wherein said 
feature includes at least one feature selected from a group of features comprising a 
Haar-like feature, an extended feature, a mirror invariant feature, and a variance 
feature. 

45. (Original) The computer-readable medium as recited in Claim 43, wherein said 
pre-filter stage includes a linear filter based on a weak learner. 

46. (Withdrawn) The computer-readable medium as recited in Claim 41 , wherein 
said boosting chain is trained using face images, non-face images, and weak classifiers. 

47. (Withdrawn) The computer-readable medium as recited in Claim 46, wherein 
said boosting chain includes a plurality of boosting nodes arranged in an order within 
said boosting chain, said boosting chain is trained using boosting classifiers 
corresponding to said boosting nodes, and each of said boosting nodes is constructed 
based on its preceding node in said order. 

48. (Withdrawn) The computer-readable medium as recited in Claim 41 , wherein 
said boosting chain includes a hierarchical chain structure. 

49. (Withdrawn) The computer-readable medium as recited in Claim 41, wherein 
said boosting filter stage includes an LSVM optimization. 
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50. (Withdrawn) The computer-readable medium as recited in Claim 41 , wherein 
said post-filter stage includes a masking process, a lighting correction process, a 
histogram equalization process, a color filter process, and an SVM filter process. 

51 . (Original) The computer-readable medium as recited in Claim 41 , further 
comprising employing at least one feature-based algorithm that uses at least one 
feature selected from a group of features including at least one Haar-like feature, at 
least one extended feature, at least one mirror invariant feature, and at least one 
variance features. 

52. (Withdrawn) The computer-readable medium as recited in Claim 41 , further 
comprising performing in-plane estimation to predict an orientation of said face image 
data and applying an up-right detector to pre-rotated image data corresponding to the 
orientation prediction. 

53. (Withdrawn) The computer-readable medium as recited in Claim 50, wherein 
said SVM filter process is configured to reduce redundancy in a feature space 
associated with at least one intermediate candidate portion, and performs wavelet 
transformation of said at least one intermediate candidate portion to produce a plurality 
of sub-bands portions. 

54. (Withdrawn) The computer-readable medium as recited in Claim 53, further 
comprising selectively cropping at least one of said plurality of sub-band portions. 
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55. (Currently Amended) An apparatus comprising: 
one or more processors; and 

memory having instructions executable by the one or more processors to detect at 
least one human face within a digital image, the memory including: 

a boosting filter stage configured to process a set of initial candidate portions 
of digital image data using a boosting chain to produce a set of intermediate 
candidate portions, wherein the boosting chain includes a plurality of boosting chain 
nodes to identify candidate portions and a boot strap function following each of the 
plurality of boosting chain nodes, the boot strap function to use a weak learner of a 
previous boosting chain node in training another boosting chain node of the boosting 
chain , wherein the weak learner includes building a simple decision stump on a 
histogram of a Haar-like feature on a training set : and 

a post-filter stage configured to process said set of intermediate candidate 
portions to produce a set of final candidate portions, wherein at least one of said 
final candidate portions includes detected face image data. 

56. (Withdrawn) The apparatus as recited in Claim 55, wherein said logic is further 
configured to divide a digital image into a plurality of portions, and wherein at least one 
of said plurality of portions has a shape selected from a group of shapes comprising a 
rectangle and a square. 
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57. (Original) The apparatus as recited in Claim 55, wherein said multiple stage 
face detection scheme further includes a pre-filter stage wherein said logic is configured 
to output said set of initial candidate portions selected from said plurality of portions 
based on at least one feature. 

58. (Original) The apparatus as recited in Claim 57, wherein said feature includes 
at least one feature selected from a group of features comprising a Haar-like feature, an 
extended feature, a mirror invariant feature, and a variance feature. 

59. (Original) The apparatus as recited in Claim 57, wherein as part of said pre- 
filter stage said logic includes a linear filter based on a weak learner. 

60. (Withdrawn) The apparatus as recited in Claim 55, wherein said boosting 
chain is trained using face images, non-face images, and weak classifiers. 

61 . (Withdrawn) The apparatus as recited in Claim 60, wherein to provide said 
boosting chain said logic includes a plurality of boosting nodes and a plurality of boot 
strap functions arranged in an alternating order within said boosting chain, and wherein 
said boosting chain is trained using boosting classifiers corresponding to said boosting 
nodes, and wherein at least one sample weight associated with one of said boot strap 
functions is adjusted based on at least one classification error of a weak classifier 
associated with a previous boosting node. 
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62. (Withdrawn) The apparatus as recited in Claim 55, wherein said boosting 
chain is operatively arranged in a hierarchical chain structure. 

63. (Withdrawn) The apparatus as recited in Claim 55, wherein said boosting filter 
stage includes an LSVM optimization configured to determine a global maximum. 

64. (Withdrawn) The apparatus as recited in Claim 55, wherein as part of said 
post-filter stage said logic is further configured to perform at least one process selected 
from a group of processes that includes a lighting correction process, a histogram 
equalization process a color filter process, and an SVM filter process. 

65. (Withdrawn) The apparatus as recited in Claim 55, wherein said logic is further 
configured to output information associated with at least said final candidate portion, 
said information at least identifying said final candidate portion. 

66. (Withdrawn) The apparatus as recited in Claim 65, wherein said information 
includes rotation data associated with at least said final candidate portion. 

67. (Original) The apparatus as recited in Claim 55, wherein said logic is further 
cooperatively configured to implement at least one feature-based algorithm that uses at 
least one feature selected from a group of features including at least one Haar-like 
feature, at least one extended feature, at least one mirror invariant feature, and at least 
one variance features. 
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68. (Withdrawn) The apparatus as recited in Claim 55, wherein said logic is further 
operatively configured to perform in-plane estimation that detects an orientation of said 
face image data, and up-right face detection based on said in-plane estimation, wherein 
said up-right face detection identifies out-plane rotation variations of said face image 
data, 

69. (Withdrawn) The apparatus as recited in Claim 64, wherein as part of said 
SVM filter process said logic is configured to reduce redundancy in a feature space 
associated with at least one intermediate candidate portion based on wavelet 
transformation of said at least one intermediate candidate portion that produces a 
plurality of sub-bands portions. 

70. (Withdrawn) The apparatus as recited in Claim 69, wherein said logic is further 
configured to selectively crop at four sub-band portions. 
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